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Abstract 

We discuss the form of the entropy for classical hamiltonian systems with long-range interaction 
using the Vlasov equation which describes the dynamics of a iV-particle in the limit N — » 00. 
The stationary states of the hamiltonian system are subject to infinite conserved quantities due 
to the Vlasov dynamics. We show that the stationary states correspond to an extremum of the 
Boltzmann-Gibbs entropy, and their stability is obtained from the condition that this extremum is 
a maximum. As a consequence the entropy is a function of an infinite set of Lagrange multipliers 
that depend on the initial condition. We also discuss in this context the meaning of ensemble 
inequivalence and the temperature. 
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Systems interacting through long-range forces can present some types of behavior that 
are not observed in more common systems. For example inequivalence of the microcanonical 
and canonical ensembles, negative specific heat, violent relaxation (rapid relaxation towards 
a non-^ian „ion ary state), 8U pe rdlnUS10 » and a,n g Q^QQ. The m08 t 
obvious example of long-range interaction is the gravitational force, which is difficult to 
study due to its divergence at short distances. A quite simple model that retains most 
of the behavior 
model (see 

Tsallis entropy could describe the statistical properties of such systems 

nnn 

although some criticism has been raised in the literature [21, LU, Hia]. Here we present a 
different approach which can shed some light on the problem, and also discuss some relevant 
aspects of the meaning of temperature for long-range interacting systems. 



found in realistic systems is the so-called Hamiltonian Mean Field (HMF) 
DDDD and references therein). Recently some authors proposed that the 

F such systems jlfll . H, 12, 



Let us first consider a system of N identical particles described by the Hamiltonian 

N „2 N 

# = E|r+ E ^-rj), (1) 

i=l zm i<j=l 

with pi and the momentum and position of the i-th particle respectively, andi (p is the 
interaction potential. The force is long-ranged if the potential decays at long distances as 
\ri — ij| -a with a < D, with D the spatial dimension. In the limit N —>■ oc the inter-particle 
correlations are negligible, and the system is described in the mean-field approximation by 



the Vlasov equation 



df df „ df 
at or <7v 



where / is the one-particle mass distribution function in phase space and F(r) = 
—dU(r)/dr is the mean-field force. The mean-field potential is given by U(r) = J <p(r — 
r')f(p',r',t)d D p'd D r'. The Casimir functionals C s [f] = J s(f(p,r,t))d D pd D r are conserved 
by the Vlasov dynamics, where s(f) is an arbitrary function of /. This implies that the 
Vlasov equation (j2J) admits an infinity of stable stationary solutions. Any distribution which 
is an extremum (maximum or minimum) of a Casimir C s for a given function s(f) is a stable 
stationary solution of the Vlasov equation. 

However real systems have always a finite number of particles, and corrections of order 
1/N must be considered to take into account collisional processes, that are important in the 
very long-time regime and for systems with a number of particles not sufficiently large. The 



kinetic equation in either case can be obtained in different ways and we refer the reader to 
Reference ^| for details. Nevertheless even for finite N the stationary state of the Vlasov 
equation describes, for a sufficiently long time, a quasi-stationary state of the real system 
(up to <D(1/N) effects). 

The Boltzmann-Gibbs entropy is given by S = — J /jv log fNd D Yi ■ ■ ■ d D YNd D p\ ■ ■ ■ d D pN, 
where is the complete iV-particle distribution function. In the mean-field limit (N — > oo) 
the distribution f N factorizes as f N (r 1 , . . . ,r N ,p 1 , . . . ,p N ,t) = f(p 1 ,r 1 ,t)---f(p N ,r N ,t), 
and the entropy is thus written as 

S=-Nff(r, p, t) log /(r, p, f) d D r d D p. (3) 

The maximization of the entropy S subject to the energy and normalization constraints: 

n = J ^f(v,p,t)d D vd D p+y ( l ) (v-v')f(v,p,t)f(v',p',t)d D vd D v'd D pd D p' = E, (4) 

1 = J f(r,p,t)d D rd D p = l, (5) 

leads to the usual Maxwell-Boltzmann distribution. The stationary states of the Vlasov 
dynamics are obtained by maximizing a Casimir C s with the constrains in eqs. (J3J and (|5j) . 
This Casimir plays the role of a "generalized entropy", and the sign of its second variation 
yields the stability condition for the stationary state. This is the procedure adopted in 
Reference |s| to study the stability of stationary states of the HMF model. This model 
describes a system of N interacting planar rotors with hamiltonian (JIJ), r 4 = 9i, m = 1 and 
interacting potential 0(rj — rj) = v(9i — 9j) = 1 — cos(#j — 9j), and such that Pi is the angular 
momentum conjugate to the angle 9{. We note that in this model the time evolution presents 
violent relaxation into a quasi- stationary state with a life-time diverging with increasing iV 
and ensemble inequivalence, and is therefore a prototypical model for the study of long-range 
interacting systems 

BEL 

In order to undestrand the nature of the entropy in systems with long-range interactions, 
we suppose that all microstates compatible with the given constraints are equally probable. 
This amounts to maximize the Boltzmann-Gibbs entropy in the mean-field limit (eq. EJ) 
with the constraints shown in eqs. (0) and © and all the Casimirs, and for all possible 
functions s. Of course this is not an easy task since we have an infinite non-enumerable set of 
constraints. Nevertheless we can simplify this problem by restricting ourselves to analytical 
distribution functions (i. e. functions of class C°°), which is not a restriction for almost all 



physical situations. Following this reasoning, the only non-vanishing Lagrange multipliers 
are those associated to the energy and normalization constrains as well as those associated 
with Casimirs defined by an analytic function s. It is therefore equivalent to consider only 
the Casimirs of the form C n [f] = J f n d D rd D p, with n = 1, 2, 3, . . . The extremum of S under 
these Casimir and eqs. (0J), (0) constraints is equivalent to the extremum of the functional 
F = jjS — Xh'H — A/X — Y^=2 X n C n , where A#, A/ and A n are Lagrange multipliers. The 
1/N factor is introduced for convenience and is equivalent to a rescaling of the Lagrange 
multipliers. Computing the functional derivative of F with respect to / we have: 

SF[f] 



- log / - 1 - A, - X H e(v, p) - £ nXnP- 1 = 0, (6) 



with e(r, p) = p 2 /2m + U(r), and thus 

oo 

G(f) = log / + A, + 1 + J2 n ^f n - 1 = -A^r, p). (7) 

n=l 

Supposing the function G is invertible we obtain /(r, p) = A#e(r, p)) = $(e(r, p)). 

Distributions of this form are precisely the stationary states of the Vlasov equation. Since 
e(r, p) depends on /(r, p) the latter is given self-consistently. For a homogeneous system, 
the mean force vanishes and e(r, p) = p 2 /2m. At this point we note that if / never vanishes, 
then G is analytic as a function of /, and any analytic function G can be written in the form 
of eq. (JZJ), i. e. it is obtained considering only the Casimirs with s(f) = f". We conclude 
that we can take the Lagrange multipliers associated with Casimirs other than C n [f] equal 
to zero. 

The stability of a stationary state is usually determined by requiring that it is an ex- 
tremum (maximum or minimum) of a given Casimir under the energy and normalization 
constraints [8J. In the present approach, stability is associated to the condition of maximal 
entropy, i. e. neither a minimum nor a saddle point. The equivalence of criteria should also 
be proved. In this letter we will restrict ourselses to the case of homogeneous stationary 
states of the HMF model for the sake of a more succinct presentation. 

Similarly to Reference [^] we first define the x and y components of the total magnetization 
of the system of plane rotors by 

M x [f] = J f(6,p,t) cos9 d9 dp; M y [f] = J f(9,p,t) sinO d9 dp. (8) 
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The second variation of F[f] computed at the extremum fo(9,p) must be negative for a 
maximum. Thus 

X H 



dO dp 
Differentiating eq. 



^ oo 
Z n=2 



l)A„/ * 



n-2 



5f + 



(M x [Sf]) 2 + (M y [6f}) 2 



< 0. (9) 



with respect to p and using the result in eq. © we have: 



V 



X H I dOdp-jj 5f(6, p, ty + X H (M x [6 f]) z + (M y [5 /])' 
Jo 



< 0. 



(10) 



Introducing the Fourier expansion 5f(9,p) = J2n i c n(p) cosnO + s n (p) sinn#] , into eq. (fTUj) 
and using Xh > we obtain 



dp 



P_ 



2tTC q + 7T 



E(4 + 



n>l 



7T J dp C\ + 7T J dpS 



< 0. 



(11) 



The type of stationary distribution function expected is an even function monotonously 
increasing for p < and monotonously decreasing for p > 0, which implies that p/ f' Q < 0. 
Since the contribution of the terms with Co, c n and s n with n > 1 are always non-positive, 
the maximum condition eq. (fTTj) can be written as W[ci] + W[si] < 0, with 

r -i 2 

W[h)= [ dpn^h{p) 2 + 7T 2 ( dph{p) . (12) 



fa 

Using the Cauchy-Schwarz inequality we have that 

2 



dp h(p) 



i 2 



dp 



Hp)J-p/fo(p) 



< 



P 



dp 



h{p) 2 p 

1M 1 



(13) 



-p/fd(p) 

which implies W[h] < n J dp [p h{p) 2 / fo(p)] ■ [1 + ttJ dp f' (p) /p] . Since pj fb(p) < we 
finally obtain: 1 + tt J dpf' Q (p)/p < 0, which coincides with the stability criterion obtained in 
Reference jq|, up to a different normalization for fn. Thus the condition of maximal entropy 
subject to all Casimir invariants leads to the same condition as obtained from the non-linear 
stability analysis of Yamaguchi et al. |8j by imposing that the state is the extremum of a 
given Casimir. 

Once the form of the entropy is known, the temperature of the system may be defined by 
1/T = OS /BE. This is not necessarily identical to the Lagrange multiplier A# associated to 
the energy constraint. The temperature T is not the only relevant parameter to characterize 
the meta-equilibrium states of the system corresponding to the stationary states of the 
Vlasov equation. Indeed for two similar systems, with all its constituents interacting with 



the same long-range force, the condition of statistical equilibrium (most probable state) is 
such that the temperature and the derivative of S with respect to to all Casimirs have the 
same value for both systems. On the contrary if one tries to probe the temperature of the 
system using a smaller system (thermometer) in such a way that its interaction is different in 
nature, i. e. a short range interaction, then the equilibrium state will be attained only after 
a very long time, of the order of the relaxation time of the whole system, when both systems 
reach a Maxwell-Boltzmann velocity distribution. In fact this is an expected behavior since 
even a small system is sufficient to break the time invariance of the Casimirs. In order to 
illustrate this point, the HMF model is modified to include a term that describes a system 

n 

with a short-range interaction ans a coupling term |18| : 

iVi+jV 2 „2 i Ni N!+N 2 N 2 

H = E l+»rE^-ffj)+ E «(0*-0*u)+*E"(**-*«-"i). (14) 
i=i z jv i i<j=i i=m+i i=i 

where a is a coupling constant, N\ and N 2 the number of particles in system 1 (with long- 
range interaction) and system 2 (with short-range interaction), respectively. We integrate 
numerically the hamiltonian equations using the fourth order simpletic integrator of Refer- 
ence |l9j . For system 1 we have chosen the well-studied "water-bag" initial condition with 
an uniform distribution for the angular moments in the interval [— po,Po] and a completely 



uniform distribution for the angles, and po = y/QUi — 3 where U% is the energy per particle, 
and the total potential energy is N\/2. This state is the limit of a family of analytic distri- 
butions of the form f(6,p) = C {1 + tanh [a (jpQ + p 2 ))]} , for a — > oo (C is a normalization 
constant). The water-bag state is stable for an energy per particle U > 7/12 [sj]. We also 
consider for system 2 a water-bag initial condition but with 9i = 0. In order to have a small 
thermal coupling between the two systems we fix a = 0.05. It can be easily shown that 
the temperature for the water-bag state is also half the kinetic energy per particle. Fig- 
ure ^ shows the time evolution for the kinetic and potential energies of both systems with 
Ni = 100, 000 and N 2 = 100 in such a way that system 2 acts like a small thermometer. Sys- 
tem 1 stays in the water-bag state, while system 2 do not thermalize. Eventually after a very 
long time they will both reach the standard canonical equilibrium. The attempt to define a 
thermometer to measure the temperature of these systems as reported by Baldovin et al. 
works only for a very special type of initial condition, and cannot be reproduced for more 
general states. In fact if the long-range interacting system is in contact with a thermal bath 
at a given temperature, the only possible equilibrium is the Maxwellian distribution. This 



Kinetic and potential energy per particle 



0,5 



0,3 



0,2 



0,1 



1 










K 1 






.... U, 






















1,1,1,1, 



1000 2000 3000 4000 5000 

time 



FIG. 1: Kinetic and potential energies per particle with N% = 100,000 (long-range) and N2 = 100 
(short-range) obtained from 50 simulations. The initial energies per particle are XJ\ = 0.69 and 
U2 = 0.35, and the time-step used is At = 0.2 with an error AE/E ~ 10~ 8 . We let both system 
evolve without coupling until t = 100 such that system 2 is in a gaussian velocity distribution. 

Kinetic and potential energy per particle Velocity distribution functions 
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FIG. 2: (a) Kinetic and potential energies per particle with N\ = 100,000 and N2 = 100,000 for 
only one simulation and (b) velocity distribution functions for both systems at t = 20, 000. The 
interaction is turned on at t = 100. 

is essentially the reason why the microcanonical and canonical ensembles are not equivalent. 
Figure shows the kinetic and potential energies for the case Ni = N2 = 100,000. Now 
the water-bag initial condition is rapidly perturbed when the interaction is turned on and 
the system evolves to a gaussian velocity distribution, as shown in Figure Eb- 

We have shown that the condition of maximal entropy subject to the normalization, 
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energy and Casimir constraints is equivalent to the non-linear stability of the stationary 
states of the Vlasov equation. Therefore, in the mean-field approximation (N — > oo), the 
entropy for a system with long-range interaction with a well behaved distribution function 
depends on an enumerable infinite set of parameters, i. e. the Lagrange multipliers A/, Xh 
and A n for n — 2, . . . , oo. These parameters depend in a complicated way on the values of the 
constraints defined by the initial condition, the latter being difficult to determine in realistic 
systems. The proposal of the Tsallis statistics, which involves only two free parameters, 
the temperature and the entropic index q, to describe the meta-equilibrium distribution in 
systems with long-range interaction is therefore limited in scope. It can only describe a 
specific type of stationary state among an infinity of different possibilities. Even for a finite 
iV system it was shown in Reference p] that for a water-bag initial condition the system 
eventually reaches a stationary state with an exponential tail in the distribution, contrary 
to the power law behavior of the Tsallis statistics. The reasonable fitting of simulation 
data obtained from the Tsallis functional form stems from the fact that it depends on two 
parameters, while the Maxwellian depends only on one. Therefore for an even distribution 
function one can obtain a correct fit up to its fourth moment, while only the dispersion can 
be fitted correctly using a Maxwellian distribution. It is a well known fact that distribution 
functions that are well behaved and that have the same first four moments are usually very 
close. This explains why the Tsallis statistics can give good fitting up to some accuracy. 
The small differences between the fitted function and the real function can nevertheless be 
essential as for instance if one needs a correct form for the tails of the distribution. Also the 
equilibrium properties of such systems are complicated to study since the type of coupling 
is essential to determine which constraints are kept, while for usual systems only the energy 
constraint is present and is always preserved. 

The Boltzmann-Gibbs entropy is then the correct form to be used. As an importante con- 
sequence we note that for a homogeneous state the mean field force vanishes and the entropy 
is computed using eqs. (jHJ) and / = $(e(r, p)) with U — 0, and therefore it is both additive 
and extensive, even despite the long range-nature of the interaction. For an inhomogeneous 
state the situation is more complicated and both properties are usually lost. The use of a 
non-extensive entropy by its own definition is meaningless and may lead to wrong conclu- 
sions. The non-extensivity or non-additivity of the entropy results uniquely from the usual 
definition of the Boltzmann-Gibbs entropy in the presence of correlations among the con- 



S 



stituents of the system, as in inhomogeneous states of long-range interacting systems. The 
use of the Boltzmann-Gibbs entropy is equivalent to suppose that all microstates compatible 
with the given constraints are equiprobable, which is a quite reasonable assumption. Using 
any other definition of entropy introduces a non-equiprobability of states, which can result 
from some "hidden" constraints not considered explicitly (e. g. the Casimir invariants). If 
this is so, the type of non-equiprobability changes for different values of such constraints, 
as well as the definition of the entropy, to take account of the change of the probabilities 
of the microstates. Therefore a fixed form for a generalized entropy cannot take care of all 
possible types of non-equiprobability. 
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